Refrigerator

ABSTRACT

A refrigerator is provided. The refrigerator may include a main body having a storage compartment, a first door rotatably installed at a first side of the main body to open and close a first portion of the storage compartment, and a second door rotatably installed at a second side of the main body to open and close a second portion of the storage compartment. A first camera may be installed at the first door to take a picture of an interior of the first storage compartment during rotation of the first door, and a second camera may be installed at the second door to take a picture of the interior of the first storage compartment during rotation of the second door. A controller may combine plural pictures taken by the first camera and the second camera into a single corrected image of a region of the first compartment spanning from the first door to the second door.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation Application of U.S. patentapplication Ser. No. 16/453,495, filed Jun. 26, 2019 (now U.S. Pat. No.10,684,069), which is a Continuation Application of U.S. patentapplication Ser. No. 15/792,912 filed Oct. 25, 2017 (now U.S. Pat. No.10,386,116), which is a Continuation Application of U.S. patentapplication Ser. No. 15/298,520, filed Oct. 20, 2016, now U.S. Pat. No.9,829,243 which is a Continuation Application of U.S. patent applicationSer. No. 15/040,333, filed Feb. 10, 2016, now U.S. Pat. No. 9,503,635,which is a Continuation Application of U.S. application Ser. No.14/190,450, filed Feb. 26, 2014, now U.S. Pat. No. 9,285,162, whichclaims priority under 35 U.S.C. § 119 to Korean Application10-2013-0032525 filed in Korea on Mar. 27, 2013, whose entiredisclosures are hereby incorporated by reference.

BACKGROUND 1. Field

This relates to a refrigerator, and more particularly to a refrigeratorwhich may provide information related to items stored therein.

2. Background

A refrigerator may supply cold air generated via driving of arefrigeration cycle to store items in a low temperature state. A usermay open a door of the refrigerator in order to view an interior of therefrigerator and contents of the interior of the refrigerator. Notknowing quantities and types of items stored in the refrigerator maycause inconvenience when purchasing replenishment items.

BRIEF DESCRIPTION OF THE DRAWINGS

The embodiments will be described in detail with reference to thefollowing drawings in which like reference numerals refer to likeelements wherein:

FIG. 1 is a perspective view of a refrigerator in accordance with anembodiment as broadly described herein;

FIG. 2 is a block diagram of a terminal, in accordance with anembodiment as broadly described herein;

FIG. 3 is a front view of a refrigerator, in accordance with anembodiment as broadly described herein;

FIG. 4 is a control block diagram for the refrigerator shown in FIG. 3;

FIG. 5 is an exploded perspective view of a door rotation drive deviceof the refrigerator shown in FIG. 3;

FIG. 6 is a schematic view of rotation of one or more doors of therefrigerator shown in FIG. 3;

FIG. 7 illustrates an exemplary plurality of pictures of an interior ofthe refrigerator shown in FIG. 3;

FIG. 8 illustrates the pictures of FIG. 7 corrected and transmitted to aterminal;

FIG. 9 is an exemplary implementation of the combined picture shown inFIG. 8;

FIG. 10 is a flowchart of a picture taking process based on an elapsedopen time of a door, in accordance with an embodiment as broadlydescribed herein;

FIG. 11 is a flowchart of a picture taking process based on a rotationposition of a door when the door is open, in accordance with anembodiment as broadly described herein;

FIG. 12 is a flowchart of a picture taking process based on an elapsedtime when a door is closed, in accordance with an embodiment as broadlydescribed herein;

FIG. 13 is a flowchart of a picture taking process based on a rotationposition of a door when the door is closed, in accordance with anembodiment as broadly described herein;

FIG. 14 is a perspective view of a refrigerator, in accordance withanother embodiment as broadly described herein;

FIG. 15 is a control block diagram for the refrigerator shown in FIG.14;

FIG. 16 illustrates a plurality of pictures corrected into a singlepicture and transmitted to a terminal, in accordance with anotherembodiment as broadly described herein;

FIG. 17 is a flowchart, in accordance with another embodiment as broadlydescribed herein;

FIG. 18 is a front view of a refrigerator, in accordance with anotherembodiment as broadly described herein; and

FIG. 19 is a control block diagram of the refrigerator shown in FIG. 18.

DETAILED DESCRIPTION

Hereinafter, exemplary embodiments will be described with reference tothe accompanying drawings. In the drawings, the shape, size, and thelike of components may be exaggerated for clarity and convenience. Inaddition, the terms particularly defined in consideration ofconfigurations and operations of embodiments as broadly described hereinmay be replaced by other terms by those skilled in the art. The meaningsof these terms may be construed based on the overall content as broadlydescribed herein.

In a refrigerator as embodied and broadly described herein, a camera maybe installed at or near a door that is a movable component of therefrigerator, whereby information related to the interior of a storagecompartment of the refrigerator may be acquired via the camera. That is,although the interior of the storage compartment is in a stationarystate, the camera may be moved along with the door, and thus a regionthat may be imaged by the camera is variable. As a result, pictures ofvarious positions in the interior of the storage compartment may beacquired via a single camera.

As shown in FIG. 1, a refrigerator 100 as embodied and broadly describedherein may include a main body 100 a, a door 101 b coupled at a frontsurface of the main body 100 a, and a handle 100 c mounted on the door101 b. A dispenser 110 that dispenses cold water or ice may be providedon the door 101 b, and a display 120 that provides the user with variousinformation related to, e.g., food stored in the refrigerator 100, mayalso be provided on the door 101 b. The display 120 may also transmituser input information to other devices.

The display 120 may have various forms so long as it may displayprescribed information and enable touch input of a prescribedinstruction. In one example, the display 120 may take the form of atouchscreen that may provide for simultaneous input and display. Thedisplay 120 may be separably coupled to a front surface of the door 101b. Thus, the user may attach or detach the display 120 to or from therefrigerator 100 as needed.

Information displayed on the display 120 may be transmitted to aterminal 200 that is connected to the refrigerator 100 through anetwork. The terminal 200 may be, for example, a smart-phone that isindependent of the refrigerator 100 to allow the user to have theterminal 200 remote from the refrigerator 100. Accordingly, a userviewing the terminal 200 may recognize information related to theinterior of the refrigerator 100 even if the user does not have physicalaccess to the refrigerator 100.

With reference to FIG. 2, a terminal 200 as embodied and broadlydescribed herein may include a terminal communication device 210, anAudio/Video (NV) input device 220, a user input device 230, a terminaloutput device 240, a memory 250, an interface device 260, a RadioFrequency Identification (RFID) reader 270, a terminal controller 280,and a power supply device 290, for example. Not all of the componentsshown in FIG. 2 are essential, and the terminal 200 may include agreater or lesser number of components.

The terminal communication device 210 may include one or more modules toenable use of the Internet between the terminal 200 and a wirelesscommunication system or in an Internet protocol network in which theterminal 200 is located. For example, the terminal communication device210 may include a broadcast reception module 211, a mobile communicationmodule 212, an Internet module 213, and a short-range communicationmodule 214.

The broadcast reception module 211 may receive broadcast signals and/orbroadcast information from an external broadcast management serverthrough a broadcast channel under control of the terminal controller280, and may play back the same on a display module 241.

The mobile communication module 212 may transmit/receive wirelesssignals with at least one of a base station, an external terminal, or aserver through a mobile communication network. The wireless signals mayinclude voice signals, video call signals, or various other data basedon transmission/reception of text/multimedia messages.

The Internet module 213 may provide for wired/wireless Internetconnection. Wireless Internet technologies may include Wireless LAN(WLAN)(Wi-Fi), wireless broadband (WiBro), World Interoperability forMicrowave Access (WiMAX), High Speed Downlink Packet Access (HSDPA), andthe like.

The short-range communication module 214 may provide for short-rangecommunication. Short-range communication technologies may includeBluetooth, Radio Frequency Identification (RFID), Infrared DataAssociation (IrDA), Ultra Wideband (UWB), ZigBee, and the like.

The A/V input device 220 may receive audio signals and video signals,and may include a camera module 221 and a microphone 222, for example.

The camera module 221 may process image information including, e.g. astill image or a moving image captured by an image sensor in a videocall mode or an image capture mode. The processed image information maybe displayed on the display module 241. Image data processed in thecamera module 221 may be stored in the memory 250, or may be transmittedto, e.g., an external terminal through the terminal communication device210. Two or more camera modules 221 may be provided, depending on aparticular usage environment.

The microphone 222 may receive an external sound signal, e.g., in a callmode, a recording mode or a voice recognition mode, and may process thesound signal into electrical voice data.

The user input device 230 may receive input data to allow the user tocontrol operation of the terminal 200. The user input device 230 mayinclude a keypad, a direction key, a dome switch, a touchpad(constant-pressure/capacitive), a jog wheel, a jog switch, and the like.

The terminal output device 240 may generate visual or auditory output,and may include the display module 241 and a sound output module 242,for example.

The display module 241 may display (output) information processed in theterminal 200. For example, when displaying information related to theterminal 200 and the refrigerator 100, the display module 241 of theterminal 200 may display the interior state of the refrigerator 100. Thedisplay module 241 may include at least one of a Liquid Crystal Display(LCD), a Thin Film Transistor Liquid Crystal Display (TFT LCD), anOrganic Light Emitting Diode (OLED), a flexible display, and a 3Ddisplay.

In certain embodiments, the display module 241 may include a sensor tosense a touch motion (hereinafter referred to as ‘a touch sensor’)constructed in a layered structure (hereinafter referred to as ‘atouchscreen’), so that the display module 241 may be used as an inputdevice as well as an output device.

The touch sensor may take the form of a touch film, a touch sheet, or atouch pad, for example. The touch sensor may be configured to convert,e.g., a pressure applied to a specific portion of the display module 241or a variation of capacitance generated from the specific portion of thedisplay module 241 into an electrical input signal. The touch sensor maybe configured to detect a touch pressure applied to the display module241 as well as a touched location and an area of the touched location.

When a touch input is generated with respect to the touch sensor, thesignal(s) corresponding to the touch input may be transmitted to a touchcontroller which processes the signal(s), and transmits datacorresponding to the signal(s) to the terminal controller 280. In thismanner, the terminal controller 280 may recognize a touch to aparticular region of the display module 241.

The sound output module 242 may output data containing audio stored inthe memory 250, or may output sound informing the user of an operationalstate of the refrigerator 100. The sound output module 242 may include,for example, a receiver, a speaker, or a buzzer.

The memory 250 may store a program for processing and control of theterminal controller 280, and may contain information related to foodstored in the refrigerator 100. In addition, the memory 250 may storegraphic data to provide the user with various messages and informationvia various visual effects.

The above-described memory 250 may include a storage medium having atleast one type among a flash memory type, a hard disk type, a multimediacard micro type, a card type of a memory (for example, an SD or XDmemory), a Random Access Memory (RAM), a Static Random Access Memory(SRAM), a Read-Only Memory (ROM), an Electrically Erasable ProgrammableRead-Only Memory (EEPROM), a Programmable Read-Only Memory (PROM), amagnetic memory, a magnetic disc, and an optical disc.

The interface device 260 may connect various external devices to therefrigerator terminal 200. The interface device 260 may receive data orpower from an external device, and transfer the data or power to eachcomponent in the terminal 200, or transmit internal data of the terminal200 to an external device. For example, the interface device 260 mayinclude a wired/wireless headset port, an external charger port, awired/wireless data port, a memory card port, a port for connection of adevice having an identification module, an audio Input/Output (I/O)port, a video I/O port, and an earphone port.

The terminal controller 280 may control an overall operation of theterminal 200.

The power supply 290 may receive power from an external power sourcethrough the interface device 260 and may supply the power to operateeach component under control of the terminal controller 280.

Various exemplary embodiments described herein may be implemented in arecording medium capable of being read by a computer or a similar deviceusing, e.g., software, hardware, or a combination thereof.

According to hardware implementation, exemplary embodiments describedherein may be realized using at least one of Application SpecificIntegrated Circuits (ASICs), digital signal processors (DSPs), digitalsignal processing devices (DSPDs), programmable logic devices (PLDs),field programmable gate arrays (FPGAs), processors, controllers,micro-controllers, microprocessors, and an electric unit for performingother functions.

In some cases, exemplary embodiments described in the specification maybe implemented by the terminal controller 280.

According to software implementation, exemplary embodiments with regardto procedures and functions described in the specification may berealized by separate software modules. Each of the software modules mayperform at least one function and operation described in thespecification.

Software code may be embodied as a software application that is writtenin an appropriate programming language. The software code may be storedin the memory 250, and may be executed by the terminal controller 280.

As shown in FIG. 3, a refrigerator 100 according to one embodiment mayhave a first storage compartment 20 and a second storage compartment 90in which items may be stored, a right door 30 installed at a right sideof the main body 100 a, and a left door 50 installed at a left side ofthe main body 100 a, both the right and left doors 30 and 50 opening andclosing the first storage compartment 20.

The right door 30 may be pivotally rotated about the right side of thefirst storage compartment 20 to open and close a corresponding portionof the first storage compartment 20, and the left door 50 may bepivotally rotated about the left side of the first storage compartment20 to open and close a corresponding portion of the first storagecompartment 20. The user may fully open the first storage compartment 20by pivotally rotating both the right door 30 and the left door 50 tocheck, e.g., a type and quantity of food stored in the first storagecompartment 20 and to access the food.

According to one embodiment, the refrigerator 100 may include a firstcamera 40 installed at the right door 30 and a second camera 60installed at the left door 50.

Among the various components of a refrigerator, a door is a movablecomponent. In this exemplary embodiment, the door may open or close astorage compartment by being rotated about a single rotation axis. Thedoor has a prescribed trajectory through this rotation, and thereforehas less possibility of abnormal movement.

In the present embodiment, the first camera 40 may be installed at aninner surface of the right door 30, i.e. a surface of the right door 30facing the first storage compartment 20. Similarly, the second camera 60may be installed at an inner surface of the left door 50, i.e. a surfaceof the left door 50 facing the first storage compartment 20. Since thefirst camera 40 and the second camera 60 are installed respectively onthe right door 30 and the left door 50, the first camera 40 and thesecond camera 60 are pivotally rotated when the right door 30 and theleft door 50 are pivotally rotated relative to the main body 100 a. Asthe first camera 40 and/or the second camera 60 rotates with therespective door in this manner, the first camera 40 and the secondcamera 60 may take pictures plural times, thereby acquiring a pluralityof pictures of the interior of the refrigerator 100.

More specifically, the first camera 40 and the second camera 60 may beinstalled on racks 32 on which food is received. In certain embodiments,a cover 31 may enclose the top of the rack 32 so as to isolate food onthe rack 32 from the interior of the first storage compartment 20. Thecover 31 may, for example, rotate about one side of the rack 32 toprovide access to food received inside the cover 31, on the rack 32.

The rack 32 may include a decorative portion 34 at a front surfacethereof. The decorative portion 34 may be formed of an opaque material,and a transparent window 36 may be provided at the decorative portion 34to allow the first camera 40 or the second camera 60 to take a picturethrough the transparent window 36.

To drive the first camera 40 or the second camera 60, an electric wirefor transmission of power and a control signal may be necessary.Accordingly, the decorative portion 34 may be formed of an opaquematerial so that the interior of the rack 32 is not visible. That is,the decorative portion 34 may ensure that the electric wire extendingfrom the main body 100 a to the first camera 40 or the second camera 60is connected to the rack 32 without being exposed and visible to theuser. As the first camera 40 or the second camera 60 is installed totake a picture through the transparent window 36, distortion due to thedecorative portion 34 may be avoided.

Although FIG. 3 shows a state in which each of the first camera 40 andthe second camera 60 is installed on a single rack 32 of each door 30and 50, the first camera 40 and/or the second camera 60 may be installedon a plurality of racks of each door 30 and/or 50. More specifically,each of the right door 30 and the left door 50 includes a plurality ofracks 32, and therefore a plurality of first cameras 40 and secondcameras 60 may be provided at each door 30 and 50.

The plurality of racks 32 installed within the first storage compartment20 may be full of food. Therefore, providing the plurality of firstcameras 40 and/or second cameras 60 may allow the first cameras 40and/or the second cameras 60 to take pictures at various heights, whichmay ensure more clear transmission of information related to the storedfood in the refrigerator 100.

In addition, in the case in which the plurality of first cameras 40and/or second cameras 60 is provided, the first cameras 40 and/or thesecond cameras 60 may be aligned in a single line. In this case, thesingle line may extend in a vertical direction confronting the main body100 a.

In certain embodiments, the first camera 40 and the second camera 60 maybe installed at different heights. The right door 30 and the left door50 may respectively include the racks 32 installed at different heights.Accordingly, to ensure that the first camera 40 and the second camera 60installed at different heights take desired pictures, an installationdirection or a zoom-in or zoom-out function of each camera 40 and 60 maybe controlled.

According to one embodiment, the first storage compartment 20 and thesecond storage compartment 90 may define separate storage spaces. Thatis, the first storage compartment 20 and the second storage compartment90 may be opened and closed by different doors.

If the first storage compartment 20 is a refrigerating compartment, thesecond storage compartment 90 may be a freezing compartment. On thecontrary, if the first storage compartment 20 is a freezing compartment,the second storage compartment 90 may be a refrigerating compartment.Alternatively, if the first storage compartment 20 and the secondstorage compartment 90 define separate spaces, both the first storagecompartment 20 and the second storage compartment 90 may equally serveas refrigerating compartments or freezing compartments.

Each of the right door 30 and the left door 50 may include a doorrotation drive device 10 configured to open and close the first storagecompartment 20. That is, two door rotation drive devices 10 may beprovided to rotate the right door 30 and the left door 50, respectively.

The first storage compartment 20 may be open as one or both of the doorrotation drive devices 10 rotates the right door 30 and/or the left door50 in a specific direction. On the other hand, the first storagecompartment 20 may be closed as each of the door rotation drive devices10 rotates the right door 30 and/or the left door 50 for the in anopposite direction.

FIG. 4 is a control block diagram associated with the refrigerator shownin FIG. 3.

A controller 80 may combine a plurality of pictures taken by the firstcamera 40 and the second camera 60 with one another, and may correct thepictures into a single image of an interior region of the first storagecompartment 20, from the right door 30 to the left door 50. Thecontroller 80 may combine a plurality of pictures taken by the firstcamera 40 and the second camera 60, thereby providing the user with animage that the user may easily and intuitively recognize. The controller80 may combine the plurality of pictures with one another, and correctthe respective pictures. Alternatively, combination of the plurality ofpictures may be implemented by an external control device providedexternal to the refrigerator 100, rather than being implemented by thecontroller 80.

According to one embodiment of the present invention, a door rotationposition sensor 130 may be provided to sense a rotation position of theright door 30 and/or a rotation position of the left door 50. The doorrotation position sensor 130 may be integrated with the door rotationdrive device 10, and may sense whether or not the right door 30 and/orthe left door 50 for the first storage compartment reaches apredetermined rotation position.

When the right door 30 and/or the left door 50 for the first storagecompartment reaches a predetermined rotation position, the door rotationposition sensor 130 may transmit a related signal to the controller 80to instruct the first camera 40 and/or the second camera 60 to take apicture.

In certain embodiments, a plurality of rotation positions may bepredetermined with respect to each of the right door 30 and the leftdoor 50. This allows the first camera 40 and the second camera 60 totake pictures plural times.

The door rotation position sensor 130 may include a Hall sensor usingHall effects. The Hall sensor may find the magnitude and direction of amagnetic field using Hall effects in which a potential difference isproduced across a conductor carrying an electric current when a magneticfield is applied in a direction perpendicular to that of the currentflow.

According to one embodiment, a timer 140 may measure passage of time. Inaddition to general passage of time, the timer 140 may measure, inparticular, moving time of the right door 30 and/or the left door 50.When moving time measured by the timer 140 exceeds a predetermined time,the timer 140 may transmit a related signal to the controller 80 toallow the controller 80 to instruct the first camera 40 and/or thesecond camera 60 to take a picture.

According to one embodiment, a door opening/closing sensor 150 may senseopening or closing of the right door 30 and/or the left door 50. Thedoor opening/closing sensor 150 may sense whether or not the right door30 and/or the left door 50 is released from contact with the main body100 a, for example, thereby sensing whether the right door 30 and/or theleft door 50 opens or closes the first storage compartment 20. The dooropening/closing sensor 150 may transmit information related to openingor closing of the right door 30 and/or the left door 50 to thecontroller 80.

According to one embodiment, a door rotation direction sensor 160 maysense a rotation direction of the right door 30 and/or a rotationdirection of the left door 50. The door rotation direction sensor 160may include a plurality of Hall sensors to sense a rotation position ofthe right door 30 and/or the left door 50 based on a position of thesequentially affected hall sensors.

The door rotation direction sensor 160 may sense a rotation direction ofthe right door 30 and/or the left door 50, and transmit a related signalto the controller 80. That is, the controller 80 may detect a rotationdirection of the right door 30 and/or the left door 50 with assistancefrom the door rotation direction sensor 160.

When each of the right door 30 and the left door 50 is rotated in aspecific direction, the controller 80 may determine that each of theright door 30 and the left door 50 is rotated to open the first storagecompartment 20. On the other hand, when each of the right door 30 andthe left door 50 is rotated in a direction opposite to the specificdirection, the controller 80 may determine that each of the right door30 and the left door 50 is rotated to close the first storagecompartment 20.

According to one embodiment, a storage device 82 may be provided tostore an image corrected by the controller 80. The storage device 82 maystore all images corrected by the controller 80 including the mostrecently corrected image as well as previously corrected images. Theimage(s) stored in the storage device 82 may be transmitted to theterminal 200 or the display 120, and the user may recognize informationrelated to the interior of the refrigerator 100 via the terminal 200 orthe display 120.

According to one embodiment, the door rotation drive device 10 may drivethe right door 30 and/or the left door 50. For example, the doorrotation drive device 10 may be driven in response to a signal input bythe user via the input device 122, thereby opening or closing the rightdoor 30 and/or the left door 50, depending on the input andcorresponding signal. That is, the door rotation drive device 10 mayopen or close the first storage compartment 20 by rotating the rightdoor 30 and/or the left door 50 forward or in reverse.

The door rotation drive device 10 may include a stepper motor which maybe rotated by an angle proportional to a given pulse number based on thesequence of step pulses. That is, a rotation angle of the right door 30and/or the left door 50 may be precisely controlled by applying apredetermined pulse to the stepper motor.

Through use of the door rotation drive device 10 including the steppermotor, the door rotation drive device 10 may sense a rotation directionand a rotation position of the right door 30 and/or the left door 50.That is, through use of the door rotation drive device 10 including thestepper motor, the door rotation position sensor 130 and the doorrotation direction sensor 160 of FIG. 4 may be omitted.

According to one embodiment, a communication device 84 may be providedto transmit an image corrected by the controller 80 to an externaldevice. In this case, the communication device 84 may transmit acorrected image to the terminal communication device 210 as shown inFIG. 2. In particular, the communication device 84 may transmit, e.g.,an image stored in the storage device 82 or an image corrected by thecontroller 80 to an external device provided outside of the refrigerator100.

FIG. 5 is an exploded perspective view of the door rotation drive deviceshown in FIG. 3.

The door rotation drive device 10 may include a bracket 12, one side ofwhich is coupled to the main body 100 a, and a motor 18 connected to thebracket 12.

The motor 18 may be embedded in the door 30, 50 and may be mounted atthe center of rotation, about which the door 30, 50 is rotated relativeto the main body 100 a. As such, the motor 18 may be rotated along withthe door 30, 50.

The bracket 12 may have a cylindrical receiving groove 14, and a linkcrank 16 may be received in the receiving groove 14. A rotating shaft 19of the motor 18 may be inserted into the link crank 16. The link crank16 may be fixed in the receiving groove 14 so that it is not rotatablerelative to the receiving groove 14. Since the bracket 12 is fixed tothe main body 100 a, consequently, the link crank 16 is fixed to themain body 100 a, and thus is not rotated relative to the main body 100a. That is, since the link crank 16 is kept stationary even if therotating shaft 19 of the motor 18 is rotated, the motor 18 is rotated,and consequently the door 30, 50 is rotated. The motor 18 may be astepper motor. That is, the motor 18 may rotate the right door 30 and/orthe left door 50 by a predetermined angle, thereby controlling anopening degree of the first storage compartment 20.

As shown in FIG. 6, the right door 30 and/or the left door 50 ispivotally rotatable relative to the main body 100 a, and the firstcamera 40 and/or the second camera 60 may take pictures a plurality oftimes as the doors 30, 50 rotate.

As shown in FIG. 6, a region imaged by the first camera 40 and/or thesecond camera 60 may vary as the right door 30 and/or the left door 50is rotated. However, since the right door 30 and the left door 50 bothrotate about a vertical axis of the main body 100 a, each of the firstcamera 40 and the second camera 60 has a constant picture taking heighteven if the doors 30, 50 are rotated.

The first camera 40 may take a picture one or more times when the rightdoor 30 is rotated relative to the main body 100 a by an angle less than90 degrees. This is because the first camera 40 may take a picture ofthe interior of the first storage compartment 20 or the interior of theleft door 50 when the right door 30 is rotated relative to the main body100 a by an angle less than 90 degrees.

For example, the first camera 40 may take pictures when the right door30 is rotated relative to the main body 100 a by angles of, for example,40 degrees, 65 degrees, and 90 degrees. At these positions of the rightdoor 30, the first camera 40 may take a picture of a region of the firststorage compartment 20 proximate to the left door 50 and a picture ofthe interior of the left door 50.

The second camera 60 may take a picture one or more times when the leftdoor 50 is rotated relative to the main body 100 a by an angle less than90 degrees. This is because the second camera 60 may take a picture ofthe interior of the first storage compartment 20 or the interior of theright door 30 when the left door 50 is rotated relative to the main body100 a by an angle less than 90 degrees.

In particular, the second camera 60 may take pictures when the left door50 is rotated relative to the main body 100 a by angles of, for example,40 degrees, 65 degrees, and 90 degrees. At these positions of the leftdoor 50, the second camera 60 may take a picture of a region of thefirst storage compartment 20 proximate to the right door 30 and apicture of the interior of the right door 30.

Although each of the first camera 40 and the second camera 60 is fixedto its respective door 30, 50, the first camera 40 and the second camera60 may take pictures of various regions because the right door 30 andthe left door 50 are rotated. That is, it is possible to take picturesof several regions in which food is stored in the first storagecompartment using the single first camera 40 and the single secondcamera 60.

In addition, the first camera 40 and the second camera 60 may take aplurality of pictures based on a rotation duration of the right door 30and the left door 50.

More specifically, the opening of the right door 30 and the left door 50may be sensed by the door opening/closing sensor 150. Then, when aprescribed time has elapsed after the door opening/closing sensor 150senses opening of the right door 30 and/or the left door 50, the firstcamera 40 and the second camera 60 may take a picture.

In this case, the right door 30 and the left door 50 may be pivotallyrotated by the door rotation drive device 10. That is, the door rotationdrive device 10, which is driven by the motor 18, may have apredetermined angular velocity, and the first camera 40 and the secondcamera 60 may take pictures at desired positions based on a timeinterval measured by the timer 140.

The time interval measured by the timer 140 may be set in such a mannerthat a rotation angle of the right door 30 and/or the left door 50 withrespect to the main body 100 a is approximately 40 degrees, 65 degrees,and 90 degrees. That is, when the right door 30 and/or the left door 50is rotated by the door rotation drive device 10, the timer 140 may set apoint in time when each of the first camera 40 and the second camera 60takes a picture.

When the door opening/closing sensor 150 senses opening of the rightdoor 30 or the left door 50, the first camera 40 and the second camera60 take a picture as the right door 30 and/or the left door 50 opens thefirst storage compartment 20. In this case, the first camera 40 and thesecond camera 60 may take pictures at door rotation angles of, forexample, 40 degrees, 65 degrees, and 90 degrees in sequence.

In the above-described case, the door rotation direction sensor 160 maysense whether or not the right door 30 and/or the left door 50 isrotated in a direction to open the first storage compartment 20 based ona rotation direction of the right door 30 and/or the left door 50.

Alternatively, the first camera 40 and the second camera 60 may take apicture when the right door 30 and/or the left door 50 is rotated in adirection to close the first storage compartment 20.

Typically, the user opens the right door 30 and/or the left door 50,introduces food into or retrieves food from the first storagecompartment 20, the right door 30 or the left door 50, and then closesthe right door 30 and/or the left door 50. That is, the latestinformation related to food stored in the first storage compartment 20,the right door 30 and/or the left door 50 may be acquired when the usercloses the right door 30 and/or the left door 50.

If information related to food received in the first storage compartment20, the right door 30 and/or the left door 50 is acquired when the rightdoor 30 and the left door 50 is first opened, there is high likelihoodof the corresponding information being changed.

In contrast, in the present embodiment, as the door rotation directionsensor 160 senses that the right door 30 and/or the left door 50 isrotated to close the first storage compartment 20, the first camera 40and/or the second camera 60 may take a picture.

The door rotation direction sensor 160 may allow the first camera 40 andthe second camera 60 to take pictures at the door rotation angles of,for example, 90 degrees, 65 degrees, and 40 degrees in sequence when theright door 30 and/or the left door 50 is rotated to close the firststorage compartment 20. In this case, the first camera 40 and the secondcamera 60 takes pictures in a sequence opposite to the sequence oftaking pictures when the doors 30, 50 are rotated to open the firststorage compartment 20.

Even when the right door 30 and/or the left door 50 is rotated in adirection to close the first storage compartment 20, the timer 140 maybegin to measure time when doors 30, 50 are at an angle of 90 degreeswith respect to the main body 100 a.

After a prescribed time has passed from time when the doors 30, 50 areat an angle of 90 degrees with respect to the main body 100 a, it may bedetermined that the right door 30 and/or the left door 50 is at an angleof 65 degrees or 40 degrees, and at this time the first camera 40 and/orthe second camera 60 may take a picture. In this case, the right door 30and/or the left door 50 may be rotated at a constant angular velocity bythe door rotation drive device 10. That is, when the right door 30and/or the left door 50 is rotated at a constant angular velocity, arotation angle of the right door 30 and/or the left door 50 may beeasily determined based on a time measured by the timer 140.

FIG. 7 illustrates a plurality of pictures taken by the first camera 40and the second camera 60 as the doors 30, 50 rotate. For example, inFIG. 7, the three left pictures may be taken by the first camera 40 andthree right pictures may be taken by the second camera 60, and the sixpictures taken by the first camera 40 and the second camera 60 may becombined with one another by the controller 80.

Alternatively, instead of three pictures, each of the first camera 40and the second camera 60 may take four or more pictures, or one or twopictures. That is, a number of pictures taken by the first camera 40 andthe second camera 60 may be controlled by controlling picture takingpositions and the number of picture taking times of the first camera 40and the second camera 60.

FIG. 8 is a front view of a terminal 200 displaying the pictures of FIG.7 which have been corrected and transmitted to the terminal 200.Although FIG. 8 illustrates the corrected/combined image display on theterminal 200, the same information may be transmitted to the display120.

In this case, the image contains content related to the interior of thefirst storage compartment 20. That is, the image may sequentially show,starting from the left side, the interior of the left door 50, theinterior of the first storage compartment 20, and the interior of theright door 30. The image may be shown as if the right door 30 and theleft door 50 are open and exposed to the user, so that the imagedisplayed on the screen appears as if the user directly opens the rightdoor 30 and the left door 50, and the user may intuitively and easilyrecognize information related to food stored in the refrigerator.

The image may be a single panoramic picture. That is, the single picturemay prevent an unnecessary increase in photo capacity when the pictureis transmitted to the user.

The user may recognize information related to the state, type, andamount of food stored in the first storage compartment 20 by simplyviewing the image. Accordingly, it may be unnecessary to frequently openthe right door 30 and/or the left door 50 of the refrigerator 100, andenergy consumption may be reduced by preventing leakage from cold air ofthe first storage compartment 20 due to opening of the right door 30and/or the left door 50. In addition, when the user is away from home,the user may determine food to be purchased and food not to be purchasedusing the image. Accordingly, waste of food due to repeated purchase andinconvenience caused when not purchasing necessary food may beprevented.

FIG. 9 illustrates an exemplary implementation example, in which theexemplary image shown in FIG. 8 may be processed to provide the userwith a shopping list of items that the user needs to purchase. Theshopping list of items may be produced and managed by the user asinformation related to food is directly extracted from the image, or asthe user extracts information related to food and additionally inputsand manages the information.

FIG. 10 is a flowchart of a picture taking process based on an elapsedtime when a door is open, according to one embodiment as broadlydescribed herein.

First, the door opening/closing sensor 150 may sense opening or closingof the door (S10).

Next, the timer 140 measures movement time of the door, beginning whenthe door opening/closing sensor 150 senses the opening or closing of thedoor (S12). The timer 140 may measure an elapsed time starting from amoment when the door begins to be opened. Assuming that the door isrotated at a constant angular velocity by the door rotation drive device10, a rotation position of the door may be easily determined from theelapsed time.

Even if the door is not driven by the door rotation drive device 10, arotation position of the door based on an elapsed time may be predictedby calculating an average angular velocity of the refrigerator doorduring a typical manual rotation of the door.

The camera takes a picture based on the elapsed time measured by thetimer 140 (S14). Since the first camera 40 and the second camera 60 arerotated along with the door, positions of the first camera 40 and thesecond camera 60 vary as time passes. Accordingly, the first camera 40and the second camera 60 may take different pictures as time passes.

Then, it is determined whether or not a predetermined time, as measuredby the timer 140, has elapsed (S16). The predetermined time may be, forexample, an amount of time for the door to rotate to a fully open orfully closed position. If the predetermined time has not elapsed andthere remains time for the first camera 40 and the second camera 60 tomake additional pictures, movement time of the door is continuouslymeasured (S12).

On the other hand, if the predetermined time has elapsed, it may berecognized that the first camera 40 and the second camera 60 have takenall pictures necessary. That is, the first camera 40 and the secondcamera 60 are no longer taking pictures.

Next, the controller 80 combines the pictures taken by the first camera40 and the second camera 60 (S18). FIG. 7 shows one example of theplurality of pictures taken by the first camera 40 and the secondcamera.

Then, the controller 80 may correct the plurality of combined picturesinto an image as shown in FIG. 8, and transmit the corrected image tothe display 120 or to the terminal 200 via the communication device 84(S20).

FIG. 11 is a flowchart of a picture taking process based on a rotationposition of the door when the door is open, according to one embodimentas broadly described herein. In FIG. 11, instead of the time measured bythe timer 140, the first camera 40 and the second camera 60 may take apicture based on a rotation position of the right door 30 and a rotationposition of the left door 50. For convenience of explanation, partsdifferent from those of FIG. 10 will be described, and a descriptionrelated to the same or similar parts will be omitted hereinafter.

When opening of the door is sensed (S10), the door rotation positionsensor 130 senses a rotation position of the right door 30 and arotation position of the left door 50 (S22).

When the right door 30 and the left door 50 reach predetermined rotationpositions, the first camera 40 and the second camera 60 take a picture(S24). Since a plurality of rotation positions may be predetermined, thefirst camera 40 and the second camera 60 may take a plurality ofpictures.

Then, it is determined whether or not the right door 30 and the leftdoor 50 reach all predetermined rotation positions (S26). That is, inthe case in which the predetermined rotation positions are set topositions where the door is rotated by, for example, 40 degrees, 65degrees, and 90 degrees with respect to the main body 100 a, it may bedetermined whether or not the doors have reached all positionscorresponding to the respective angles.

If it is determined that the right door 30 and the left door 50 havereached all the predetermined rotation positions, the door rotationposition sensor 130 may continuously sense a rotation position of theright door 30 and a rotation position of the left door 50.

If it is determined that the right door 30 and the left door 50 havereached all the predetermined rotation positions, the controller 80 maycombine a plurality of pictures (S18).

FIG. 12 is a flowchart of a picture taking process based on an elapsedtime when the door is closed, according to one embodiment as broadlydescribed herein. In particular, FIG. 12 explains a picture takingprocess of the first camera 40 and the second camera 60 when the door isrotated in a direction to close the first storage compartment 20,differently from that of FIG. 10. Accordingly, parts different fromthose of FIG. 10 will be described, and a description related to thesame parts will be omitted hereinafter.

First, the door rotation direction sensor 160 may sense a rotationdirection of the right door 30 and a rotation direction of the left door50 (S2).

If it is determined that the right door 30 and the left door 50 arerotated in a direction to close the first storage compartment 20 (S4),movement time of the door may be measured to allow the first camera 40and the second camera 60 to take a picture.

If it is determined that the right door 30 and the left door 50 arerotated in a direction to open the first storage compartment 20, thefirst camera 40 and the second camera 60 may take a picture in the samemanner as the above description with reference to FIG. 10.

FIG. 13 is a flowchart of a picture taking process based on a rotationposition of a door when the door is closed, according to one embodimentas broadly described herein. With reference to FIG. 13, a picture takingmethod of the first camera 40 and the second camera 60 when the door isrotated in a direction to close the first storage compartment 20 will bedescribed. Accordingly, although the process of FIG. 13 is similar tothat of FIG. 12, there is a difference in that the first camera 40 andthe second camera 60 take a picture via sensing of a rotation positionof the door.

That is, in the same manner as the above description with reference toFIG. 12, the door rotation direction sensor 160 may sense that the rightdoor 30 and the left door 50 are rotated in a direction to close thefirst storage compartment 20 (S2, S4).

Then, if it is determined that the right door 30 and the left door 50are closing the first storage compartment 20, the first camera 40 andthe second camera 60 may take a picture when the right door 30 and theleft door 50 reach predetermined rotation positions thereof (S22, S24).

FIG. 14 is a perspective view of a refrigerator according to anotherembodiment as broadly described herein, and FIG. 15 is a control blockdiagram of the refrigerator shown in FIG. 14. In this embodiment, thesame parts as those of the previously described embodiment aredesignated by the same reference numerals, and a description related tothe same parts will be omitted hereinafter.

In this embodiment, the first storage compartment 20 and the secondstorage compartment 90 may define separate spaces divided by a barrier400 which is vertically installed in the main body 100 a. In this case,each of the first storage compartment 20 and the second storagecompartment 90 may provide a space in which food is stored, and mayserve as a refrigerating compartment or a freezing compartment.

The first storage compartment 20 may be open or closed by a first door330, and the second storage compartment 90 may be open or closed by asecond door 350. The first door 330 and the second door 350 may berotated relative to the main body 100 a.

The first storage compartment 20 may be provided with a first storagecompartment camera 22, and the second storage compartment 90 may beprovided with a second storage compartment camera 92. The first storagecompartment camera 22 may take a picture of the interior of the firstdoor 330, and the second storage compartment camera 92 may take apicture of the interior of the second door 350. That is, the firststorage compartment camera 22 is arranged to take a picture of foodstored in the first door 330, and the second storage compartment camera92 is arranged to take a picture of food stored in the second door 350.

The first door 330 and the second door 350 may each be provided withdoor cameras. The first door 330 may be provided with a first doorcamera 340 and the second door 350 may be provided with a second doorcamera 360. The first door camera 340 may take a picture of the firststorage compartment 20, and the second door camera 360 may take apicture of the second storage compartment 90. That is, the first doorcamera 340 is arranged to take a picture of food stored in the firststorage compartment 20, and the second door camera 360 is arranged totake a picture of food stored in the second storage compartment 90.

The refrigerator 100 may include a light source 300 installed in themain body 100 a to emit light. The light source 300 may emit light toallow the user to view food stored in the first storage compartment 20or the second storage compartment 90 when the user opens the first door330 or the second door 350. That is, the light source 300 may be drivenwhen the door opening/closing sensor 150 senses opening of the firstdoor 330 and/or the second door 350 and the first door 330 and/or thesecond door 350 is open.

In addition, the light source 300 may be driven when the user tries tocheck food stored in the first storage compartment 20 and the secondstorage compartment 90 as well as food stored in the first door 330 andthe second door 350. That is, even in a state in which the first door330 and the second door 350 close the first storage compartment 20 andthe second storage compartment 90, the light source 300 may be driven.Once the light source 300 is driven, the first storage compartmentcamera 22, the second storage compartment camera 92, the first doorcamera 340, and the second door camera 360 may take a picture.

The door opening/closing sensor 150 may determine that the first door330 or the second door 350 closes the first storage compartment 20 orthe second storage compartment 90 respectively. In this case, the lightsource 300 may be driven, and the first storage compartment camera 22,the second storage compartment camera 92, the first door camera 340, andthe second door camera 360 may take a picture.

In a closed state of the first door 330 and the second door 350, theinterior of the first storage compartment 20 and the second storagecompartment 90 is dark, and therefore a picture containing informationwith desired resolution cannot be taken. To solve this problem, thelight source 300 may be driven with the first door 330 and the seconddoor 350 closed.

Each of the first storage compartment camera 22, the second storagecompartment camera 92, the first door camera 340, and the second doorcamera 360 may be provided in plurality. In this case, each of theplurality of first storage compartment cameras 22, the second storagecompartment cameras 92, the first door cameras 340, and the second doorcameras 360 may be arranged in a line or in a plurality of lines tosimultaneously take a plurality of pictures.

The controller 80 may combine and correct pictures taken by the firststorage compartment camera 22, the second storage compartment camera 92,the first door camera 340, and the second door camera 360. An imagecombined and corrected by the controller 80 may be transmitted to theuser terminal 200. For example, an image as shown in FIG. 16 may betransmitted to the user terminal 200.

The image sequentially shows, starting from the left side, the interiorof the second door 350, the interior of the second storage compartment90, the interior of the first storage compartment 20, and the interiorof the first door 330. That is, the image shows a state in which thefirst door 330 and the second door 350 are fully open, and therefore theuser may intuitively recognize information related to the type, state,and amount of food stored in the refrigerator 100 from the image.

Thus, the user may acquire information related to food stored in therefrigerator 100 without opening the first door 330 and/or the seconddoor 350. In addition, differently from the previously describedembodiment, information related to the interior of the refrigerator 100may be acquired from pictures taken in a closed state of the first door330 and the second door 350.

FIG. 17 is a flowchart according to another embodiment as broadlydescribed herein.

The user may operate the input device 122, or generation of a signal ata prescribed interval may be set (S110). In this case, the user mayacquire information related to food stored in the refrigerator byoperating the input device 122 or based on periodically generatedsignals.

In response to a signal to instruct the camera to take a picture, thedoor opening/closing sensor 150 may sense opening or closing of thefirst door 330 or the second door 350.

If it is determined that the first door 330 or the second door 350 isclosed, the light source 300 is actuated (S130), because the firststorage compartment 20 and the second storage compartment 90 are darkwhen the first door 330 and the second door 350 are closed.

Once the light source 300 is actuated, the first storage compartment 20and the second storage compartment 90 have sufficient luminance, and thefirst door camera 340, the second door camera 360, the first storagecompartment camera 22, and the second storage compartment camera 92 maybe operated to take a picture (S140).

Since the first door camera 340, the second door camera 360, the firststorage compartment camera 22, and the second storage compartment camera92 are kept stationary, each camera may take a picture only one time,because the same picture is acquired in a stationary state of thecamera, even if the camera takes a plurality of pictures.

The controller 80 combines pictures taken by the first door camera 340,the second door camera 360, the first storage compartment camera 22, andthe second storage compartment camera 92 with one another (S150).

Then, the controller 80 may correct the combined pictures into an image,and transmit the corrected image to the display 120 or the terminal 200via the communication device 84 (S160).

The corrected image may be stored in the storage device 82, whichenables history management of respective images.

FIG. 18 is a front view of a refrigerator according to anotherembodiment as broadly described herein, and FIG. 19 is a control blockdiagram of the refrigerator shown in FIG. 18.

This embodiment may be applied to a refrigerator having a configurationas described above with respect to FIG. 13, and may employ a combinedpicture taking method including picture taking method described withrespect to the embodiment shown in FIG. 3 and the embodiment shown inFIG. 14. That is, a further embodiment may be applied to therefrigerator having a configuration as shown in FIG. 3. In addition,information related to food stored in a refrigerating compartment or afreezing compartment may be acquired even in a closed state of the door,similar to that in the embodiment shown in FIG. 14.

This embodiment is a combination of the embodiment described withrespect to FIG. 3 and the embodiment described with respect to FIG. 14,and thus a detailed description related to respective components will beomitted hereinafter. However, it will be appreciated that the componentsaccording to this embodiment perform the same function as theabove-described components, and thus the above description may beequally applied.

According to this embodiment, in addition to the first camera 40installed at the right door 30 and the second camera 60 installed at theleft door 50, a storage compartment camera 420 may be installed to takea picture of the interior of the right door 30 and the interior of theleft door 50. In certain embodiments, a plurality of storage compartmentcameras 420 may be arranged in plural lines.

More specifically, as shown in FIG. 6, the right door 30 and the leftdoor 50 are pivotally rotated to allow the first camera 40 and thesecond camera 60 to take a picture, which may result in generation of animage as shown in FIG. 8. In this case, the image may sequentially show,starting from the left side, the interior of the left door 50 for thefirst storage compartment, the interior of the first storage compartment20, and the interior of the right door 30 for the first storagecompartment.

In addition, the light source 300 may be actuated as described abovewith reference to FIG. 16, and the storage compartment camera 420, thefirst camera 40 and the second camera 60 may be driven to take apicture, which may result in generation of an image as shown in FIG. 8.

In this embodiment, the user may acquire information related to foodstored in the refrigerator 100 based on pictures taken via pivotalrotation of the door. In addition, the user may also acquire informationrelated to food stored in the refrigerator 100 even in a state in whichthe storage compartment is closed by the doors.

In a refrigerator as embodied and broadly described herein, a user mayrecognize information related to items stored in a refrigerator withoutopening a door of a storage compartment of the refrigerator.

In a refrigerator as embodied and broadly described herein, even whenthe user is away from home, the user may recognize information relatedto items stored in the refrigerator via a portable terminal.

In a refrigerator as embodied and broadly described herein, the user mayview a display of an interior of the refrigerator similar to that when arefrigerator door is directly opened, which assists the user in easilyrecognizing the interior state of the refrigerator.

A refrigerator as embodied and broadly described herein may provide auser with information related to items stored in the refrigerator.

A refrigerator as embodied and broadly described herein may provide auser with an image as if the user opens the refrigerator.

A refrigerator, as embodied and broadly described herein, may include amain body having a first storage compartment in which food is stored, aright door for the first storage compartment, the right door beinginstalled to a right side of the main body to open the first storagecompartment via pivotal rotation thereof about the right side of thefirst storage compartment, a left door for the first storagecompartment, the left door being installed to a left side of the mainbody to open the first storage compartment via pivotal rotation thereofabout the left side of the first storage compartment, a first camerainstalled to the right door for the first storage compartment, the firstcamera taking a picture during rotation of the right door for the firststorage compartment, a second camera installed to the left door for thefirst storage compartment, the second camera taking a picture duringrotation of the left door for the first storage compartment, and acontrol unit configured to combine a plurality of pictures taken by thefirst camera and the second camera with one another and correct thepictures into an image showing a region from the right door for thefirst storage compartment to the left door for the first storagecompartment.

The refrigerator may further include a door rotation position sensingunit configured to sense a rotation position of the left door for thefirst storage compartment or the right door for the first storagecompartment.

The control unit may instruct the first camera or the second camera totake a picture when the right door for the first storage compartment orthe left door for the first storage compartment reaches a predeterminedrotation position.

The first camera or the second camera may take a picture at least onetime or more when the right door for the first storage compartment orthe left door for the first storage compartment is rotated relative tothe main body by an angle less than 90 degrees.

The first camera or the second camera may be installed to an inner sideof each door.

The first camera may take a picture of a left region of the firststorage compartment and the second camera may take a picture of a rightregion of the first storage compartment.

The image may sequentially show, starting from the left side, theinterior of the left door for the first storage compartment, theinterior of the first storage compartment, and the interior of the rightdoor for the first storage compartment.

The refrigerator may further include a door rotation drive unitconfigured to rotate the right door for the first storage compartment orthe left door for the first storage compartment.

The first camera or the second camera may begin to take a picture whenthe right door for the first storage compartment or the left door forthe first storage compartment is rotated in a direction perpendicular tothe main body to close the first storage compartment.

The refrigerator may further include a door opening/closing sensing unitconfigured to sense opening or closing of the right door for the firststorage compartment or the left door for the first storage compartment.

The first camera or the second camera may take a picture based on anelapsed time when the right door for the first storage compartment orthe left door for the first storage compartment is rotated to open thefirst storage compartment.

The refrigerator may further include a door rotation direction sensingunit configured to sense a rotation direction of the right door for thefirst storage compartment or the left door for the first storagecompartment.

The first camera or the second camera may take a picture when the doorrotation direction sensing unit senses that the right door for the firststorage compartment or the left door for the first storage compartmentis rotated in a set direction.

The set direction may be a door rotation direction to close the firststorage compartment.

The refrigerator may further include a communication unit configured totransmit the image to an external device.

The refrigerator may further include a display unit configured to showthe image to the user.

The refrigerator may further include a storage unit configured to storethe last image corrected by the control unit, and a communication unitconfigured to transmit the last image stored in the storage unit to anexternal device.

In accordance with another embodiment as broadly described herein, arefrigerator may include a main body having a storage compartment inwhich food is stored, a door configured to open or close the storagecompartment, a storage compartment camera installed in the storagecompartment, a door camera installed to the door, and a control unitconfigured to combine a plurality of pictures taken by the storagecompartment camera and the door camera with one another and correct thepictures into an image showing the door and the storage compartment.

The refrigerator may further include a door opening/closing sensing unitconfigured to sense opening or closing of the door.

The storage compartment camera and the door camera may take a picturewhen the door opening/closing sensing unit senses that the door closesthe storage compartment.

Any reference in this specification to “one embodiment,” “anembodiment,” “example embodiment,” etc., means that a particularfeature, structure, or characteristic described in connection with theembodiment is included in at least one embodiment of the invention. Theappearances of such phrases in various places in the specification arenot necessarily all referring to the same embodiment. Further, when aparticular feature, structure, or characteristic is described inconnection with any embodiment, it is submitted that it is within thepurview of one skilled in the art to effect such feature, structure, orcharacteristic in connection with other ones of the embodiments.

Although embodiments have been described with reference to a number ofillustrative embodiments thereof, it should be understood that numerousother modifications and embodiments can be devised by those skilled inthe art that will fall within the spirit and scope of the principles ofthis disclosure. More particularly, various variations and modificationsare possible in the component parts and/or arrangements of the subjectcombination arrangement within the scope of the disclosure, the drawingsand the appended claims. In addition to variations and modifications inthe component parts and/or arrangements, alternative uses will also beapparent to those skilled in the art.

What is claimed is:
 1. A refrigerator, comprising: a main body having astorage compartment; a door coupled to the main body and configured toopen and close the storage compartment; a light source provided at thestorage compartment; a door opening/closing sensor; a basket provided onthe door; a decorative portion arranged below the basket on the door; acamera arranged to the decorative portion; and a controller configuredto actuate the light source to control the camera to take pictures ofthe storage compartment when the door opening/closing sensor detectsthat the door closes the storage compartment, wherein the decorativeportion is formed of an opaque material, and wherein the decorativeportion has a transparent window, and wherein the camera takes a picturethrough the transparent window.
 2. The refrigerator according to claim1, wherein the storage compartment has a first storage compartment and asecond storage compartment, and the door has a first door and a seconddoor, wherein the first door is rotatably coupled to a first end portionof the main body, and configured to open and close an open front face ofthe first storage compartment, the first door having baskets to storefood and the baskets to be provided on an inner surface of the firstdoor, and a second door is rotatably coupled to a second end portion ofthe main body, and configured to open and close an open front face ofthe second storage compartment.
 3. The refrigerator according to claim2, wherein the camera has a plurality of cameras arranged to the firstdoor in a row.
 4. The refrigerator according to claim 3, wherein one ofthe plurality of cameras is arranged on a upper portion of the firstdoor and one of the plurality of cameras is arranged on a lower portionof the first door.
 5. The refrigerator according to claim 3, wherein theplurality of cameras are provided at the door and configured to take apicture, a plurality of baskets are arranged to the door, a plurality ofdecorative portions are arranged to the door, one of the cameras isprovided on an upper decorative portion, and one of the cameras isprovided on a lower decorative portion.
 6. The refrigerator according toclaim 5, wherein the cameras take photos simultaneously.
 7. Therefrigerator according to claim 2, further comprising: a barriervertically installed in the main body and separating the first storagecompartment from the second storage compartment.
 8. The refrigeratoraccording to claim 1, wherein edges of the transparent window aresurrounded with the decorative portion.
 9. The refrigerator according toclaim 1, wherein the camera is arranged on a middle portion of the doorin a width direction.
 10. The refrigerator according to claim 1, whereinthe door has a plurality of cameras provided at the door, and whereinthe cameras are arranged on same positions in a width direction and havedifferent heights.
 11. The refrigerator according to claim 1, whereinthe decorative portion is thicker, in vertical direction, in a middleportion than two edge portions.
 12. The refrigerator according to claim1, further comprising: a storage device configured to store the picturestaken by the camera.
 13. The refrigerator according to claim 12, furthercomprising: a communication device configured to transmit the picturesstored in the storage device to an external device.
 14. The refrigeratoraccording to claim 13, wherein the external device is connected to therefrigerator through a network.
 15. The refrigerator according to claim13, wherein the communication device transmits the pictures when thecontroller receives a user's request signal.
 16. The refrigeratoraccording to claim 1, wherein the storage compartment has arefrigerating chamber.
 17. A refrigerator, comprising: a main bodyhaving a storage compartment; a door coupled to the main body andconfigured to open and close the storage compartment; a light sourceprovided at the storage compartment; a door opening/closing sensor; abasket provided on the door; a decorative portion arranged below thebasket on the door; a camera arranged to the decorative portion; and acontroller configured to actuate the light source to control the camerato take pictures of the storage compartment when the dooropening/closing sensor detects that the door closes the storagecompartment, wherein the decorative portion is formed of an opaquematerial, wherein the door has a plurality of cameras provided at thedoor, and wherein the cameras are arranged on same positions in a widthdirection and have different heights.
 18. A refrigerator, comprising: amain body having a storage compartment; a door coupled to the main bodyand configured to open and close the storage compartment; a light sourceprovided at the storage compartment; a door opening/closing sensor; abasket provided on the door; a decorative portion arranged below thebasket on the door; a camera arranged to the decorative portion; and acontroller configured to actuate the light source to control the camerato take pictures of the storage compartment when the dooropening/closing sensor detects that the door closes the storagecompartment, wherein the decorative portion is formed of an opaquematerial and wherein the decorative portion is thicker, in verticaldirection, in a middle portion than two edge portions.